Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.



rss RSS

SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Top Domains
collection
158,991
ITEMS
1.8B
VIEWS
collection
eye 1.8B
A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings .
Topics: daily, popular sites, Alexa
Top News
collection
109,507
ITEMS
678M
VIEWS
collection
eye 678M
A daily collection of hundreds of the world's top news sites.
Topics: daily, news
top_domains-00500
collection
2,755
ITEMS
68.5M
VIEWS
by Internet Archive
collection
eye 68.5M
top_domains-00900
collection
3,873
ITEMS
51.8M
VIEWS
by Internet Archive
collection
eye 51.8M
top_domains-00600
collection
5,844
ITEMS
49.8M
VIEWS
by Internet Archive
collection
eye 49.8M
top_domains-00300
collection
4,270
ITEMS
44.9M
VIEWS
by Internet Archive
collection
eye 44.9M
top_domains-00250
collection
1,872
ITEMS
43.4M
VIEWS
by Internet Archive
collection
eye 43.4M
top_domains-00800
collection
6,855
ITEMS
40.7M
VIEWS
by Internet Archive
collection
eye 40.7M
top_domains-00350
collection
1,996
ITEMS
40.2M
VIEWS
by Internet Archive
collection
eye 40.2M
top_domains-01500
collection
2,562
ITEMS
35.8M
VIEWS
by Internet Archive
collection
eye 35.8M
top_domains-00700
collection
1,494
ITEMS
34.7M
VIEWS
by Internet Archive
collection
eye 34.7M
top_domains-02250
collection
2,283
ITEMS
34M
VIEWS
by Internet Archive
collection
eye 34M
top_domains-00450
collection
2,724
ITEMS
32.2M
VIEWS
by Internet Archive
collection
eye 32.2M
top_domains-00400
collection
1,933
ITEMS
32M
VIEWS
by Internet Archive
collection
eye 32M
top_domains-02750
collection
1,795
ITEMS
30.4M
VIEWS
by Internet Archive
collection
eye 30.4M
top_domains-02500
collection
2,740
ITEMS
30.1M
VIEWS
by Internet Archive
collection
eye 30.1M
worldpress.org
collection
457
ITEMS
29.7M
VIEWS
by http://worldpress.org/
collection
eye 29.7M
yahoo.com
collection
1,025
ITEMS
29.6M
VIEWS
collection
eye 29.6M
top_domains-07500
collection
1,976
ITEMS
28.4M
VIEWS
by Internet Archive
collection
eye 28.4M
top_domains-02000
collection
1,987
ITEMS
27.5M
VIEWS
by Internet Archive
collection
eye 27.5M
top_domains-01000
collection
2,313
ITEMS
25.3M
VIEWS
by Internet Archive
collection
eye 25.3M
top_domains-09500
collection
3,577
ITEMS
25M
VIEWS
by Internet Archive
collection
eye 25M
top_domains-04500
collection
1,721
ITEMS
22M
VIEWS
by Internet Archive
collection
eye 22M
time.com
collection
519
ITEMS
21.8M
VIEWS
by http://time.com
collection
eye 21.8M
top_domains-04250
collection
1,988
ITEMS
21.7M
VIEWS
by Internet Archive
collection
eye 21.7M
top_domains-04000
collection
2,404
ITEMS
21.6M
VIEWS
by Internet Archive
collection
eye 21.6M
vkontakte.ru
collection
319
ITEMS
21.4M
VIEWS
by http://vkontakte.ru
collection
eye 21.4M
top_domains-08750
collection
1,794
ITEMS
21.3M
VIEWS
by Internet Archive
collection
eye 21.3M
top_domains-08000
collection
1,222
ITEMS
21.1M
VIEWS
by Internet Archive
collection
eye 21.1M
top_domains-03000
collection
1,672
ITEMS
20.8M
VIEWS
by Internet Archive
collection
eye 20.8M
themeforest.net
collection
402
ITEMS
20.5M
VIEWS
by themeforest.net
collection
eye 20.5M
top_domains-06000
collection
2,867
ITEMS
20.2M
VIEWS
by Internet Archive
collection
eye 20.2M
stumbleupon.com
collection
170
ITEMS
19.9M
VIEWS
by http://stumbleupon.com
collection
eye 19.9M
top_domains-01750
collection
1,015
ITEMS
19.6M
VIEWS
by Internet Archive
collection
eye 19.6M
top_domains-09000
collection
2,694
ITEMS
19.2M
VIEWS
by Internet Archive
collection
eye 19.2M
huffingtonpost.com
collection
4,211
ITEMS
19.1M
VIEWS
by http://huffingtonpost.com
collection
eye 19.1M
nbcnews.com
collection
733
ITEMS
18.8M
VIEWS
by nbcnews.com
collection
eye 18.8M
top_domains-05250
collection
2,917
ITEMS
18.6M
VIEWS
by Internet Archive
collection
eye 18.6M
top_domains-06750
collection
2,904
ITEMS
18.5M
VIEWS
by Internet Archive
collection
eye 18.5M
top_domains-00500
web
eye 18.4M
favorite 0
comment 0
Source: top_domains-00500
top_domains-06250
collection
1,273
ITEMS
18.3M
VIEWS
by Internet Archive
collection
eye 18.3M
top_domains-07000
collection
1,885
ITEMS
18.2M
VIEWS
by Internet Archive
collection
eye 18.2M
top_domains-04750
collection
1,128
ITEMS
17.9M
VIEWS
by Internet Archive
collection
eye 17.9M
top_domains-05500
collection
6,177
ITEMS
17.4M
VIEWS
by Internet Archive
collection
eye 17.4M
taringa.net
collection
881
ITEMS
17.2M
VIEWS
by taringa.net
collection
eye 17.2M
nytimes.com
collection
895
ITEMS
17.1M
VIEWS
by http://nytimes.com
collection
eye 17.1M
top_domains-03750
collection
1,669
ITEMS
16.6M
VIEWS
by Internet Archive
collection
eye 16.6M
top_domains-06500
collection
1,682
ITEMS
16.2M
VIEWS
by Internet Archive
collection
eye 16.2M
top_domains-03500
collection
1,363
ITEMS
16M
VIEWS
by Internet Archive
collection
eye 16M
edgi monitor
collection
1,066
ITEMS
15.5M
VIEWS
collection
eye 15.5M
top_domains-08250
collection
3,124
ITEMS
15.4M
VIEWS
by Internet Archive
collection
eye 15.4M
tumblr.com
collection
447
ITEMS
15.2M
VIEWS
by http://tumblr.com
collection
eye 15.2M
top_domains-01250
collection
801
ITEMS
14.5M
VIEWS
by Internet Archive
collection
eye 14.5M
sfgate.com
collection
3,311
ITEMS
14.3M
VIEWS
by http://sfgate.com
collection
eye 14.3M
buzzfeed.com
collection
1,831
ITEMS
14.2M
VIEWS
by buzzfeed.com
collection
eye 14.2M
latimes.com
collection
549
ITEMS
14.2M
VIEWS
by http://latimes.com
collection
eye 14.2M
top_domains-08500
collection
825
ITEMS
14.2M
VIEWS
by Internet Archive
collection
eye 14.2M
current.com
collection
326
ITEMS
14.1M
VIEWS
by http://current.com/
collection
eye 14.1M
top_domains-03250
collection
855
ITEMS
14M
VIEWS
by Internet Archive
collection
eye 14M
pinterest.com
collection
225
ITEMS
13.9M
VIEWS
by pinterest.com
collection
eye 13.9M
foxnews.com
collection
897
ITEMS
13.7M
VIEWS
by http://foxnews.com
collection
eye 13.7M
chicagotribune.com
collection
381
ITEMS
13.4M
VIEWS
by http://chicagotribune.com/
collection
eye 13.4M
top_domains-05750
collection
947
ITEMS
13.3M
VIEWS
by Internet Archive
collection
eye 13.3M
top_domains-05000
collection
873
ITEMS
13.2M
VIEWS
by Internet Archive
collection
eye 13.2M
inn.co.il
collection
474
ITEMS
12.8M
VIEWS
by http://inn.co.il/
collection
eye 12.8M
neobux.com
collection
31
ITEMS
12.6M
VIEWS
by neobux.com
collection
eye 12.6M
top_domains-09750
collection
1,324
ITEMS
12.2M
VIEWS
by Internet Archive
collection
eye 12.2M
newser.com
collection
185
ITEMS
12.1M
VIEWS
by http://newser.com/
collection
eye 12.1M
top_domains-07250
collection
1,901
ITEMS
12M
VIEWS
by Internet Archive
collection
eye 12M
guardian.co.uk
collection
1,046
ITEMS
11.9M
VIEWS
by http://guardian.co.uk/
collection
eye 11.9M
top_domains-09250
collection
1,076
ITEMS
11.8M
VIEWS
by Internet Archive
collection
eye 11.8M
top_domains-07750
collection
865
ITEMS
11.7M
VIEWS
by Internet Archive
collection
eye 11.7M
wordpress.org
collection
1,107
ITEMS
11.5M
VIEWS
by http://wordpress.org
collection
eye 11.5M
salon.com
collection
1,590
ITEMS
11.4M
VIEWS
by http://salon.com/
collection
eye 11.4M
blogspot.in
collection
195
ITEMS
11.1M
VIEWS
by blogspot.in
collection
eye 11.1M